Avalanche Collapse of Interdependent Networks 
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We reveal the nature of the avalanche collapse of the giant viable component in multiplex net- 
works under perturbations such as random damage. Specifically, we identify latent critical clusters 
associated with the avalanches of damage. Divergence of their mean size signals the approach to the 
hybrid phase transition from one side, while there are no critical precursors on the other side. We 
find that this discontinuous transition occurs in scale-free multiplex networks whenever the mean 
degree of at least one of the interdependent networks does not diverge. 
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Many complex systems, both natural and man- 
made [1, HI , can be represented as multiplex or interde- 
pendent networks. Multiple dependencies make a sys- 
tem more fragile: damage to one element can lead to 
avalanches of failures throughout the system 0, H . Re- 
cent theoretical investigation of two [6] or more [3] net- 
works in which vertices in each network mutually depend 
on vertices in other networks has shown that indeed small 
initial failures can cascade back and forth through the 
networks, leading to a discontinuous collapse of the whole 
system. It was shown in Q that there is a simple map- 
ping between the model used in [6] in which a vertex in 
one network has a mutual dependence on exactly one ver- 
tex in the other network, and a multiplex network with 
one kind of vertex but two kinds of edges. The mapping 
is achieved by simply merging the mutually dependent 
vertices from the two networks. 

In this Letter we describe the nature of such transi- 
tions. We consider a set of vertices connected by m dif- 
ferent types of edges (dependencies). The connections 
are essential to the function of each site, so that a vertex 
is only viable if it maintains connections of every type to 
other viable vertices. A viable cluster is defined as fol- 
lows: For every kind of edge, and for any two vertices i 
and j within a viable cluster, there must be a path from i 
to j following only edges of that kind. A graph containing 
two finite viable clusters is illustrated in Fig. [T] We wish 
to find when there is a giant cluster of viable vertices. 
Note that any giant viable cluster is a subgraph of the 
giant connected component of each of the m networks. 




FIG. 1: A small network with two kinds of edges (left). Ap- 
plying the algorithm described in the text non-viable vertices 
are removed leaving two viable clusters (right). 

Various parameters can be used to control the crit- 



ical behavior of this system: the mean degrees of the 
networks, amount of random damage and so on. Small 
perturbations to the system can propagate, leading to 
avalanches of further damage. In uncorrelated, random 
networks we find a discontinuous hybrid transition in the 
collapse of the giant viable cluster, similar to that seen in 
the fc-core or bootstrap percolation 0, |T(J ■ Avalanches of 
removals of vertices from the giant viable cluster increase 
in size approaching the critical point, signaling the im- 
pending collapse of the giant viable cluster. At the crit- 
ical point the mean avalanche size diverges. Below the 
transition, on the other hand, there is no precursor for 
the appearance of the giant viable cluster. The transi- 
tion is thus asymmetric. It is hybrid in nature, having a 
discontinuity like a first-order transition, but exhibiting 
critical behavior, only above the transition, like a second- 
order transition. A complete understanding of the transi- 
tion cannot therefore be had without first understanding 
this critical behavior. We have discovered critical clus- 
ters which collapse in avalanches of diverging size as the 
transition is approached. These critical clusters are thus 
responsible for both the critical scaling and the discon- 
tinuity observed in the size of the giant viable cluster. 
The critical clusters have a novel character as, unlike the 
corona clusters of the fc-core for example [t| , Avalanches 
propagate in a directed way through critical clusters. The 
critical clusters may have important practical applica- 
tions, helping to identify vulnerabilities to targeted at- 
tack, as well as informing efforts to guard against such 
attack. Surprisingly, when the degree distributions are 
asymptotically power-law P(q) oc q~ 7 the critical point 
p c (taking undamaged fraction of vertices p as the control 
parameter) remains at a finite value even when the expo- 
nents 7 of the degree distributions are below 3, remaining 
finite until both exponents reach 2. This is in stark con- 
trast to ordinary percolation, in which the threshold falls 
to zero as soon as 7 reaches 3. Furthermore, the nature 
of the transition doesn't change. Although the height of 
the discontinuity becomes extremely small near 7 = 2, it 
remains finite near this limit (see Fig. [2]). 
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FIG. 2: Size of the giant viable cluster S as a function of the 
fraction p of vertices remaining undamaged for two symmetric 
powerlaw distributed networks with, from right to left, 7 = 
2.8 , 2.5, and 2.1. The height of the jump becomes very small 
as 7 approaches 2, but is not zero, as seen in the inset, which 
is <S vs p on a logarithmic vertical scale for 7 = 2.1. 



Algorithm. — We consider a multiplex network, with 
vertices i — 1,2, ...,N connected by m kinds of ver- 
tices labeled s — a, b, .... The joint degree distribution 
is P{q a ,qb, ■■■)■ Viable clusters in any multiplex network 
may be identified by the following algorithm. 

(i) Choose a test vertex i at random from the network. 

(ii) For each kind of edge s, compile a list of vertices that 
can be reached from i by following only edges of type s. 

(iii) The intersection of these m lists forms a new candi- 
date set for the viable cluster containing i. 

(iv) Repeat steps (ii) and (iii) but traversing only the 
current candidate set. When the candidate set reaches 
an equilibrium, it is either a viable cluster, or contains 
only vertex i. 

(v) To find further viable clusters, remove the viable clus- 
ter of i from the network (cutting any edges) and repeat 
steps (i)-(iv) on the remaining network beginning from a 
new test vertex. 

Repeated application of this procedure will identify ev- 
ery viable cluster in the network. The application of this 
procedure to a finite graph is illustrated in Fig. [1] 
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FIG. 3: Viable and critical viable vertices for two interde- 
pendent networks, (a) A vertex is in the giant viable cluster 
if it has connections to giant viable subtrees (represented by 
infinity symbols) of both kinds, (b) A critical viable vertex of 
type a has exactly 1 connection to a giant sub-tree of type a. 

Basic Equations. — Let us consider the case of sparse 
uncorrelated networks, which are locally tree-like in the 
infinite size limit N — > 00. In such a network there are no 
finite clusters. In order to find the giant viable cluster, 
let us define X s , with s S {a, b, ...}, to be the probability 
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FIG. 4: Diagrammatic representation of Eq. |T} in a sys- 
tem of two interdependent networks a and b. The probability 
X a , represented by a shaded infinity symbol can be written 
recursively as a sum of second-neighbor probabilities. Open 
infinity symbols represent the equivalent probability Xi for 
network b, which obeys a similar recursive equation. 



that, on following an arbitrarily chosen edge of type s, we 
encounter the root of an infinite sub-tree formed solely 
from type s edges, whose vertices are also each connected 
to at least on infinite subtree of every other type. We call 
this a type s infinite subtree. The vector {X a , Xb, ...} 
plays the role of the order parameter. A vertex is then in 
the giant viable cluster if it has at least one edge of every 
type s leading to an infinite type s sub-tree (probability 
X s ), as shown in Fig. E^a). Using the locally tree-like 
property of the networks, we can write self consistency 
equations for the probabilities X s : 

X s =V s (X a ,X b ,...) EE 

£ ^rP(q a , q b , ...) [l-il-X.)^ 1 ] J] [l-(l-^) 9 '] 

(1) 

for each s £ {a, b, ...}. This is illustrated in Fig. |H The 
term (g s /(q s ))P(g a , <?{,, ...) gives the probability that on 
following an arbitrary edge of type s, we find a vertex 
with degrees q a ,qb, while [1 — (1— X a ) qa ] is the proba- 
bility that this vertex has at least one edge of type a =/= s 
leading to the root of an infinite sub-tree of type a edges 
(i.e. probability X a ). This becomes [1 - (l-X,)^" 1 ] 
when a — s. Solving these equations enables us to cal- 
culate all the quantities of interest. In particular, the 
relative size of the giant viable cluster is given by 



S = 



E 



P(q a ,q b ,...) J] [l-(l-*-) fc L ( 2 ) 



which is illustrated in Fig. G3a). 

A hybrid transition appears at the point where 
*S> s (X a , Xb, ...) first meets X s at a non-zero value, for all 
s. This occurs when 



det[J - I] = 



(3) 



where I is the unit matrix and J is the Jacobian matrix 
J a b = d^b/dX a . Expanding ^ s about the critical point, 
at which Eqs. ([1]) and ([3]) are both satisfied, we find the 
scaling of X s and hence S, the size of the giant viable 
cluster. For example, to consider random damage, we 
introduce a factor of p to Eqs. ([TJ and ([2]). The control 
variable p is the fraction of vertices remaining undam- 
aged. Then 



S-S c otX s -X^ oc (p-p,) 1 / 2 . 



(4) 



3 



A similar result is found for other control parameters. 

Avalanches. — To examine the hybrid transition we fo- 
cus on the case of two types of edges. Consider a viable 
vertex that has exactly one edge of type a leading to a 
type a infinite subtree, and at least one edge of type b 
leading type b infinite subtrees. We call this a critical 
vertex of type a. It is illustrated in Fig. ISJb). Each crit- 
ical vertex has one special edge on which it depends to 
remain viable; critical vertices of type a will drop out of 
the viable cluster if they lose their single link to a type 
a infinite subtree. We mark these special edges with an 
arrow leading to the critical vertex. An avalanche can 
only transmit in the direction of the arrows. A vertex 
may have outgoing edges of this kind, so that removal 
of this vertex from the giant viable cluster also requires 
the removal of the critical vertices which depend on it. 
For example, in Fig. [5J removal of the vertex labeled 1 
removes the essential edge of the critical vertex 2 which 
thus becomes non- viable. Removed critical viable ver- 
tices may in turn have outgoing critical edges, so that the 
removal of a single vertex can result in an avalanche of 
removals of critical vertices from the giant viable cluster. 
In Fig. [5j removal of 2 causes the removal of further crit- 
ical vertices 3 and 4, and the removal of 4 then requires 
the removal of 5. Thus critical vertices form critical clus- 
ters. At the head of each critical cluster is a 'keystone 
vertex' (e.g. vertex 1 in the figure) whose removal would 
result in the removal of the entire cluster. Graphically, 
upon removal of a vertex, we remove all vertices found by 
following the arrowed edges. As we approach the critical 
point (from above), the mean size of the critical clusters 
diverges. The avalanches cause a discontinuity in the size 
of the giant viable cluster, which collapses to zero. 
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FIG. 5: A critical cluster. Removal of any of the shown 
viable vertices will result in the removal of all downstream 
critical viable vertices. Removal of the vertex labeled 1 will 
result in all of the shown vertices being removed (becoming 
non- viable), while removal of vertex 4 results only in vertex 5 
also being removed. 

There are three possibilities when following an arbi- 
trarily chosen edge of a given type: i) with probability 
X s we encounter a type s infinite subtree ii) with prob- 
ability R s we encounter a vertex which has a connection 
to an infinite subtree of the opposite type, but none of 
the same type. Such a vertex is part of the giant viable 
cluster if the parent vertex was; or iii) with probability 
1 — X s — R s , we encounter a vertex which has no connec- 
tions to infinite subtrees of either kind. The probability 



R a obeys 

s »=EEn ? (fc«)( 1 - I «) ? " 1 [ 1 -( 1 - I ») ,i ] 

q a qb ^ qa ' 

(5) 

and similarly for R b . We use generating functions to 
examine the sizes of critical clusters. We first define the 
function F a (x,y) as 

Qb / \ 

K*> »)=£ Ettt a)*- -1 £ (? )w 

qa qb r=l ^ ' 

(6) 

and similarly for F b (x,y), by exchanging all subscripts a 
and b. The generating function for the size of a critical 
cluster reached upon following an arbitrary type a edge 
which does not lead to an infinite type a subtree can be 
defined in terms of these functions by 

H a {u,v) = l-X a -R a +uF a [H a (u,v),H b (u,v)} (7) 

and similarly for H b (u,v). This recursive equation can 
be understood by noting that H a (0, v) — 1 — X a — R a is 
the probability that an arbitrarily chosen edge leads to a 
'dead-end', i.e. a vertex outside the viable cluster. Here u 
and v are auxiliary variables. Following through a critical 
cluster, a factor u appears for each arrowed edge of type 
a, and v for each arrowed edge of type b. For example, the 
critical cluster illustrated in Fig. [5] contributes a factor 
u 2 v 2 . The mean number of critical vertices reached upon 
following an edge of type a, i.e. the mean size of the 
resulting avalanche if this edge is removed, is given by 
d u H a (l, 1) + d v H a (l, 1). Unbounded avalanches emerge 
at the point where d u H a (l,l) [or d v H b (l, 1)] diverges. 
Taking derivatives of Eq. 0, and using that H a (l, 1) = 
1 — X a and F a (l — X a , 1— X b ) = R a , and that, from Eqs. 
© and ©, d x F a {l-X a ,l-X b ) = d a ^ a (X a ,X b ) and 
d v F a (l-X a ,l-X b ) = {{q a )/{q b ))d a * b (X a ,X b ), gives 



d u H a (l,l) 



Rg[l-d b ^ b {X a ,X b )] 

det[J - 1] 



(8) 



From Eq. ((3]) we see immediately that this diverges at 
the critical point, meaning that the mean avalanche size 
diverges exactly at the point of the hybrid transition (i.e. 
there is only one critical point). 

Scale-free Networks. — In ordinary percolation, and 
even the fc-core and heterogeneous fc-core, networks with 
degree distributions that are asymptotically powerlaws 
P{q) ~ q 1 may exhibit qualitatively different transi- 
tions, especially when 7 < 3. To investigate such effects 
in the giant viable cluster, we consider powerlaw degree 
distributions with fixed minimum degree qo — 1 (then 
(q) ra (7 - 1)90/(7 - 2)), so that P(q s ) = C(7s)<T 7s 
where s takes the values a or b. As a control parame- 
ter we apply random damage to the system as a whole so 
that vertices survive with probability p. First consider 
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the case where either 7 a or jb, or both, is greater than 3. 
The giant viable cluster is necessarily a subgraph of the 
overlap between the giant-components of each graph. We 
know from ordinary percolation that for 7 > 3, the giant 
component appears at a finite value of p ll| . It follows 
that the giant viable cluster, also, cannot appear from 
p = 0; there must be a finite threshold p c , (with a hybrid 
transition) as for other networks such as Erdos-Renyi. 
This is true even if one of the networks has 7,5 < 3. 

The more interesting case is when both degree expo- 
nents 7 S are less than three, when the percolation thresh- 
old is zero for each network when considered separately. 
Let us write 7 a = 2 + 5 a and 7^ = 2 + 5 b , and examine the 
behavior for small 5 a and 5b- We proceed by assuming 
that in this situation, for p near p c , Eqs. ([1]) have a so- 
lution with small X a and Xb <C 1. Writing only leading 
orders of X a and Xb, and 5 a and 5 b , we find that 



hnd that 



m a {X a , X b ) = P^j-Xt (Xb - X, 



1+Si 



(9) 



and similarly for ^b(X a , Xb). The location of the critical 
point is found from Eq. (j3|) which becomes 



S a + 5 b =p Y X° a «X° b , ^ 



x„ 



x. 



(10) 



Solving Eqs. ([9} and (|T0|) and using Eq. ([2]) allows us 
to calculate X s and S at p c . We find in general that the 
hybrid transition persists as long as 5 a and 5 b are not 
zero, though the height of the discontinuity at the hy- 
brid transition becomes extremely small for 5 small. In 
experiments or simulations, this could be misinterpreted 
as evidence of a continuous phase transition. We here 
describe two representative cases. First, where 5 a <C 5b, 
that is, 7 a tends to 2 while 7b stays a little larger than 2. 
We find that the location of the discontinuous transition 
is p c « 1.195b, and the size of the giant viable cluster 
at the critical point is S c = Ae~ B / Sb with A w 3.36 
and B ps 2.89. We see that a hybrid transition occurs, 
albeit with an extremely small discontinuity, at a non- 
zero threshold p c as long as at least one of 5 a and 5b is 
not equal to zero. To examine the case that both tend 
to zero, we consider the symmetric case <5 a = <5f> = <5. 
Then X a = Xb = X, and the discontinuity is found 
by requiring W{X) = 1 [from Eq. ©]. We find that 



X r 



(1/2) 



1/5 



Pc 



245/ir 2 , and, S c = 4 1 ~ 1 /<5. The lo- 



cation of the hybrid transition tends to p — as 5 — > 0, 
and the size of the 'jump' becomes very small even for 
nonzero 5, but vanishes completely as <5 — » 0. In Fig.[2]we 
plot the size of the giant viable cluster in this symmetric 
case for three values of 7. For values not close to 2, the 
transition looks similar to that observed in, say, Erdos- 
Renyi graphs. As 7 approaches 2, however, we see that 
the height of the discontinuity becomes extremely small. 
Nevertheless, the square root scaling and non-zero crit- 
ical point are retained. Expanding *&(X) about X c we 



X - X c 

X r , 



12 



7T 2 5p c 



P-Pc 
Pc 



1/2 



(11) 



which holds so long as p — p c <C <5 3 . That is, the scaling 
is square- root in a narrow region of width 0(5 3 ) above 
the hybrid transition. This region disappears as i5 — > 0. 

Summary. — We have given an algorithm for identify- 
ing the viable clusters in any multiplex network. Un- 
der increasing damage, the giant viable cluster col- 
lapses in a discontinuous hybrid transition, in contrast to 
the smooth continuous transition found in simplex net- 
works. We have shown that this transition is signaled 
by avalanches whose mean size diverges as the collapse 
approaches. To understand this critical behavior, which 
occurs only above the transition, we successfully iden- 
tified clusters of critical vertices. These clusters deter- 
mine the structure and statistics of avalanches of dam- 
age. Avalanches sweep through the critical clusters in 
a directed fashion, and it is the diverging size of these 
clusters which accounts for the criticality. This directed 
nature stands in contrast to, for example, the corona 
clusters found in the fc-core problem [L2J. Each critical 
cluster depends upon a keystone vertex whose removal 
completely destroys the critical cluster. These keystone 
vertices are good candidates for targeted attack or im- 
munization against such attacks. 
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